07/25/2008 12:26 FAX 2125880500 FROMMER LAWRENCE & HAUG RECEIVED 01001/004 

CENTRAL FAX CENTER 

JUL 2 5 2008 



FROMMER LAWRENCE & HAUG LLP 

745 Fifth Avenue 
New York, New York 10151 
Telephone: (212) 588-0800 
Facsimile: (212) 588-0500 
E-mail: Firm@flhlaw.com 



FACSIMILE COVER LETTER 

Commissioner of Patents 
Central Fax Center 

USPTO 

(571) 273-8300 
Thomas F. Presson 
July 25, 2008 

U.S. Patent Application Serial No. 10/085,647 
SonyRef: S02P0145USOO 
SonylPD: HS 

OurRef.: 450100-03764 



To: 

Firm: 

Facsimile: 

From: 

Date: 

Re: 



Number of Pages: 4 

(including cover page) 



If you do not receive all pages or are unable lo read uie transmission, please call (Ext. 2153). 



MESSAGE: 

Further to your telephone conversation yesterday, enclosed please find pages 3, 5 and 23. 



CONFIDENTIALITY NOTICE 

The documents accompanying this transmission contain confidential infoimalion intended for a specific individual and purpose. The information 
is private, and is legally protected by law. If you are not die intended recipient, you are hereby notified that any disclosure, copying, distribution, 
or the taking of any action in reliance on the contents of this facsimile is strictly prohibited. 

00568855 



PACE 1(4 • RCVD AT 7/25/2008 12:26:05 PM [Eastern Daylight Time] * SVR:USPTO-EFXRF-6/39 * DNIS:2738300 * CSID: 2125880500 * DURATION (mm-ss):01-44 



07/25/2008 12:27 FAX 2125880500 FROMMER LAWRENCE & HAUG 12)002/004 

mm iwm mm mi - No. 8887 p. 5 

RECEIVED 

CENTRAL PAX CENTER 

JUL 2 5 2008 

The Group may be excluded ia compliance with a stream. The Group 
includes Time code. It also includes Video Object Plane (hereinafter 
called VOP). The VOP corresponds to a frame of picture in the video 
.images. Here, it includes VOP coding type and an order of reproduction. 
The information, "vop_coding_iype (2} w described in the VOP indicates 
I-picture, P-picture or B-picture. The information, "moduio^ime^ase*' 
described in the VOP indicates how many seconds it takes for a picture 
to occur after I -picture. The information, "vop_timeJncrement (1-16)" 
described in the VOP indicates how order the picture should occur, 
namely, the order of reproduction thereof. The VOP includes the 
bitstreams each indicating internal information of VOP following the 
above information. 

Many researches for transporting the bitstreams each having the 
above syntax on the Internet and/or broadcasting waves have been done. 

MPEG4 stream fails to define transport stream (hereinafter called 
TS) and packecized elementary stream (hereinafter called PES), which 
are available in the transport thereof. Thus, although a user can freely set 
TS and PES, he or she is required to alter their stream structure 
according to the transport protocol thereof. 

In ISO J3818-1/FDAM7 (ISO/IEC JTC1/SC29/WOU N3050), 
standardisation in oase of using MPEG2-TS goes on whereas 
implementing method, namely, translation method that the MPEG4 
stream is translated into an MPE02 packerized elementary stream 
(hereinafter called MPEG2-PES) packet has not been determined. 

Alternatively, MPEG4 Visual Object Sequence (ISO/IEC 14496-2) 
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packetteing a coded bitstream of digital data in accordance with a 
transport protocol is presented. The method comprises a time 
information generating step of generating time information In 
accordance with a specification of the transport protocol and a header 
generating step of generating a header that includes the time information 
generated during the time information generating step. The method 
further comprises a packet generating step of generating a packet with 
adding the header generated during the header generating step into every 
predetermined unit of bitstream* 

According to the present invention, when packetizing the coded 
bitstream of digital data in accordance with the transport protocol, for 
example, translating MPEG4 stream into MPE02-PBS packet, the time 
information is first generated in accordance with the specification of the 
transport protocol. 

The header is Illustratively detected from the ooded hitstream of 
digital data. The header analyzing unit analyzes the header thus detected. 
This permits predetermined information to be obtained therefrom. Using 
such the predetermined information allows the time information in 
accordance with the specification of transport protocol to be generated. 

Alternatively, a hit rate of the coded hitstream of digital data is 
illustratively detected. The time information in accordance with the 
specification of transport protocol is generated using such the detected 
bit rate. Using a predetermined hitstream other than the coded bitstream 
of digital data, for example, the time information contained in a stream 
of the MPBG2-PES packet form also allows the time information in 
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receiver side starts decoding from outside. The packetizer 102C 

generates the time information such as E SCR. DTS, and PTS using the 

information, vbv_occupancy and other information, Mt_rate, calculated 

according to a frame rate obtained from the information obtained by 

analyzing the headers detected from MPEG4 stream STMl, and the 

information, vhv_occupancy. It also inserts the time information into the 

PES header. 

The multiplexer 103 receives and sections the information. MPE04 
video_deseriptor and multiplexes the stream STM2 and the MPEG4 
video_descriptor thus sectioned to indicate that data contained in the 
stream STM2, which the multiplexer 103 receives, is MPEG4 stream. 

The packetizer 1 02C further comprises a bit rate calculating unit 
119 for calculating a bit rate of the stream STMl. The unit 119 receives 
the input stream STMl through the header detecting unit 111 . The unit 
1 1 9 also receives the information detected by the header buffer unit 1 1 2. 

The unit 119 calculates a frame rate according to the information, 
vop_time_increment_rcsolution and fixed_vop_time_increment, detected 
by the header buffer unit 1 12 as follws: 

frame rate [HzJ - vop - time_incrcment_resolution / 
flxed_vop_tlme_lncrement 

The unit 119 also allows a number of AUs corresponding to the 
stream STMl accessible for one second based on the frame rate thus 
calculated to be accessed. It counts an amount of the data, a number of 
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